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Abstract 

This document is an introduction to the Matlab package SDLS (Semi-Definite 
Least-Squares) for solving least-squares problems over convex symmetric cones. The 
• package is shortly presented through the addressed problem, a sketch of the imple- 

C$ , mented algorithm, the syntax and calling sequences, a simple numerical example 

and some more advanced features. The implemented method consists in solving the 
dual problem with a quasi-Newton algorithm. We note that SDLS is not the most 
competitive implementation of this algorithm: efficient, robust, commercial imple- 
mentations are available (contact the authors). Our main goal with this Matlab 
SDLS package is to provide a simple, user-friendly software for solving and exper- 
lf} . imenting with semidefinite least-squares problems. Up to our knowledge, no such 

CN ' freeware exists at this date. 
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1 General presentation 

SDLS is a Matlab freeware solving approximately convex conic-constrained least-squares 
problems. Geometrically, such problems amount to finding the best approximation of a 
point in the intersection of a convex symmetric cone with an affine subspace. In mathe- 
matical terms, those problems can be cast as follows: 

mnxj |||a;-c|| 2 

s.t. Ax = b (1) 
x G K 

where x G M n has to be found, A G M mxn , b G M. m , c6l" are given data and if is a 
convex symmetric cone. The norm appearing in the objective function is ||x|| = V x T x, 
the Euclidean norm associated with the standard inner product in R™. Note that there 
exists a unique solution to this optimization problem. 

In practice, K must be expressed as a direct product of linear, quadratic and semidef- 
inite cones. It is always assumed that matrix A has full row-rank, otherwise the problem 
can be reformulated by eliminating redundant equality constraints. 
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2 Algorithm 



SDLS is an implementation of the algorithm described in [2], which consists in solving 
the dual to problem (JT]). Specifically, the dual problem is (up to the sign and an additive 
constant) 

min y f(y) = l\\ PK (c + A T y)f-b T y (2) 

where Pk{ z ) denotes the orthogonal projection of vector z onto the cone K. It is easy to 
prove that this dual problem is smooth and convex, so it can be solved by classical op- 
timization algorithms. Among them, quasi-Newton algorithms are known to be efficient, 
and SDLS uses a Matlab implementation of the BFGS algorithm available in the Matlab 
freeware HANSO pp. The other key numerical component of SDLS is eigenvalue decom- 
position for symmetric matrices achieved by Matlab's built-in linear algebra function eig. 
We insist on the two following features: 

• Simplicity: the SDLS package consists of only 4 Matlab interpreted m-files calling 
one external package and a built-in linear algebra function. 

• Easy-to-use: as explained in the next section, the syntax follows standard patterns. 

The implementation of the algorithm of [2] in SDLS is probably not the most efficient. 
It is not meant to outperform neither the professional or commercial implementations of 
this method, nor other methods solving the same problem. Our main goal is to provide a 
simple, user-friendly, free software for solving and experimenting with semidefinite least- 
squares problems. Up to our knowledge, no such freeware exists at this date. 

3 Syntax 

SDLS has the same syntax as the widely used freeware SeDuMi for solving linear problems 
over convex symmetric cones [3J. Even though SeDuMi and SDLS share the same calling 
syntax, note that SeDuMi is aimed at solving a different problem. Namely, SeDuMi 
minimizes a linear objective function c T x while SDLS minimizes a quadratic objective 
function as in (TjQ). 

The basic calling syntax is: 

» [x,y] = sdls(A,b,c,K) 

Input arguments A, b, c are real- valued matrices as in (TjQ). SDLS exploits data sparsity, 
so that A, b and c can be Matlab objects of class sparse. If the third input argument is 
empty or not specified, then c is set to zero. 

Input argument K is a structure describing the components of the cone: 

• K.f is the number of free, i.e. unrestricted components. E.g. if K.f=2 then x(l:2) 
is unrestricted. These are always the first components in x 

• K . 1 is the dimension of the linear cone, i.e. the number of nonnegative components. 
E.g. if K.f =2 and K.l=8 then x(3:10)>=0 
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• K.q lists the dimensions of the quadratic cones. E.g. if K.l=10 and K.q=[3 7] 
then x(ll)>=norm(x(12: 13)) and x(14)>=norm(x(15:20)). The corresponding 
components of x immediately follow the K . 1 nonnegative ones 

• K.s lists the dimensions of the semidefmite cones. E.g. if K.l=20 and K.s=[4 3], 
then reshape (x (21 :36) ,4,4) and reshape (x (37: 45) ,3,3) are symmetric positive 
semidefmite matrices. These components are always the last entries in x 

Note that rotated quadratic cones (K . r) and complex Hermitian components (K . xcomplex , 
K.scomplex, K.ycomplex) are currently not supported. Please refer to SeDuMi's docu- 
mentation [3] for more details on the meaning of the fields in structure K. If the fourth 
input argument is empty or not specified, then K is the linear cone, e.g. K.f=size(A,2). 

Output argument x (same dimension as c) is the solution to SDLS problem (pQ), 
whereas y (same dimension as b) is the corresponding dual vector solving the smooth 
problem (T5]). 

4 Installation 

SDLS 1.0 is developed for Matlab version 7.2 (release 2006). It consists of a tar.gz or 
zip archive that can be downloaded from 

www . laas . f r/ ~henrion/ software/ sdls 

Unpacking the archive creates a subdirectory sdls that should be activated under your 
Matlab environment, either with the inline command addpath or with the Set Path entry 
of the File menu. 

The package HANSO, available at 

www . cs . nyu . edu/ overton/ sof tware/hanso 

must also be installed and activated under your Matlab environment. 
If SDLS is correctly installed, it should generate the following output: 

» x = sdls([l, 0] ,1) 
x = 

1 



5 Example 

As a simple illustrative example of the use of SDLS we consider the problem of calibrating 
correlation matrices. 

Correlation matrices are symmetric positive semidefinite matrices with ones along the 
diagonal. They play an important role in probability and statistics but also in combinato- 
rial optimization. Consider a symmetric matrix C obtained from a correlation matrix after 
modifications of some entries, for example due to measurement errors or post-processing. 
Those modifications may alter the positive semidefiniteness of the matrix. We want to 
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restore basic properties (positive semidefiniteness and ones along the diagonal) by com- 
puting the correlation matrix nearest to C in the Euclidean sense. This problem can 
written in the form (1TT) . 

For illustration, consider the problem of computing a nearest correlation matrix of 
size 3. Define 

» A=sparse(3,3) ; A(l,l)=l; A(2,5)=l; A(3,9)=l; 
>> b=ones(3,l); °/ ones along diagonal 
» C=[l 1/2 l;l/2 1 1/4; 1 1/4 1] 
C = 

1.0000 0.5000 1.0000 

0.5000 1.0000 0.2500 

1.0000 0.2500 1.0000 
» c=C(:); 
» K=[] ; K.s=3 

Matrix C was obtained by adding 1/2 to entries (1,3) and (3, 1) of a correlation matrix. 
Modifying these 2 entries destroyed the positive semidefiniteness: 

» min(eig(C)) 
ans = 

-0.0349 

Then we run the calibration process using SDLS: 

» [x,y] = sdls(A,b,c,K) ; 
» X = reshape (x, K. s,K. s) 
X = 

1.0000 0.4910 0.9684 
0.4910 1.0000 0.2582 
0.9684 0.2582 1.0000 

This way, we do not recover the original correlation matrix, but we get the correlation 
matrix nearest to C in the Euclidean sense. Indeed we observe that the diagonal ones 
remain whereas positive semidefiniteness is restored: 

» min(eig(X)) 
ans = 

3.0097e-16 

6 Advanced use 
6.1 Input arguments 

Optionally, tuning parameters can be specified as a fifth input argument: 
» [x,y] = sdls(A,b,c,K,pars) 

Input argument pars is a structure containing the following fields: 
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• pars.eps: relative accuracy (default le-6) 

• pars. fid: screen output (0 for no output, default 1) 

• pars.maxit: maximum number of iterations for the BFGS solver (default 200) 

• pars . reg: regularization parameter (default 0) 

• pars . scaling: scaling of the linear equation (false for no scaling, default true) 

The stopping rule of the algorithm is norm(A*x-b) <= max(l ,norm(b) ) *pars . eps 
where pars . eps is the expected relative accuracy. Since BFGS is essentially a first-order 
algorithm, pars.eps should not be set too small. Typical values are between le-4 and 
le-8, depending on the problem dimensions and scaling. 

The regularization parameter pars . reg should be used if one suspects that the qual- 
ification constraint does not hold. That is, the affine subspace may be tangent to the 
cone, or equivalently there may be no point satisfying the affine constraint in the interior 
of the cone. A typical value is pars .reg=le-6. 

When pars . scaling=true, the scaling consists simply in dividing input data A and 
b by max(l ,norm(b) ) . Otherwise, the input data are left unchanged. 

6.2 Output arguments 

An additional third output argument: 
» [x,y,info] = sdls(A,b,c,K) 

can be retrieved. Argument info contains information on the objective function of dual 
problem (jSJ), as provided by the BFGS solver: 

• info.f: function value f(y) at the optimum 

• info.g: gradient of f(y) at the optimum 

• info.H: approximation of inverse Hessian of f(y) at the optimum 

• info. time: CPU time 

The norm of the residual norm(A*x-b) is equal to the norm of the gradient norm (info . g) . 
It should be less than the absolute accuracy max(l ,norm(b) ) *pars . eps (see above) and 
it can be used as an estimate of the quality of the solution produced by SDLS. 

References 

[1] J.V. Burke, A.S. Lewis and M.L. Overton. HANSO (hybrid algorithm 
for non-smooth optimization): a Matlab package based on BFGS, bun- 
dle and gradient sampling methods. Version 1.0 released in 2006. See 
www. cs.nyu.edu/faculty/overton/ sof tware/hanso 



[2] J. Malick. A dual approach to semidefinite least-squares problems. SIAM J. Matrix 
Anal. Appl. Vol. 26, No. 1, pp. 272-284, 2004. 

[3] J.F. Sturm. Using SeDuMi 1.02, a Matlab toolbox for optimization over symmet- 
ric cones. Optimization Methods and Software. Vol. 11-12, pp. 625-653, 1999. See 
sedumi . monaster . ca 



